[cache] Refactor caching mechanism to improve response times(ROCm#18)
- Replaced the previous in-memory cache with a more efficient LRU cache implementation
- Added configurable cache size and expiration policies for better flexibility
- Fixed race conditions that occasionally caused stale data to be served
- Improved logging to track cache hits and misses more accurately
- Updated unit tests to cover edge cases related to cache invalidation
- Performance benchmarks show a 30% reduction in average request latency
- Documentation updated to reflect new caching strategy and configuration options
No breaking changes introduced; fully backward compatible.

[cache] Refactor caching mechanism to improve response times(ROCm#18)
- Replaced the previous in-memory cache with a more efficient LRU cache implementation
- Added configurable cache size and expiration policies for better flexibility
- Fixed race conditions that occasionally caused stale data to be served
- Improved logging to track cache hits and misses more accurately
- Updated unit tests to cover edge cases related to cache invalidation
- Performance benchmarks show a 30% reduction in average request latency
- Documentation updated to reflect new caching strategy and configuration options
No breaking changes introduced; fully backward compatible.

…18)"

This reverts commit 1315d92.